Multilayer depth and volume preservation of stacked meshes

ABSTRACT

Systems and methods for rendering 3D assets associated and/or configured as stacked meshes are disclosed. Stacking meshes can include loading the first mesh and the second mesh from a character definition, identifying a lowest depth mesh from the first mesh and the second mesh, identifying shared polygons from the first mesh and the second mesh, and hiding the shared polygons of the lowest depth mesh.

RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.15/799,782, filed Oct. 31, 2017, which claims priority to U.S.Provisional Application No. 62/415,881 filed Nov. 1, 2016, each of whichis hereby incorporated by reference herein in its entirety.

TECHNICAL FIELD

The present disclosure relates to electronic or other virtualrepresentations of an individual or entity in a computer generatedenvironment. In particular, the present disclosure relates to systemsand methods for generating stacked meshes preserving depth and volumefor a three dimensional (3D) asset associated with a virtual identity.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a system diagram for a persistent virtual identity system,according to one embodiment.

FIG. 2 is a block diagram of an asset transfer client, according to oneembodiment.

FIG. 3 is a block diagram of an asset lookup and delivery service,according to one embodiment.

FIG. 4 is a block diagram of a 3D character SDK, according to oneembodiment.

FIG. 5 is a block diagram for stacking multiple meshes according to oneembodiment.

FIG. 6 is a block diagram for stacking multiple meshes according to oneembodiment.

FIG. 7 is a block diagram of a persistent virtual identity system,according to one embodiment.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Individuals are increasingly interacting with computing devices,systems, and environments and with other individuals in electronic orvirtual forums, such as in computer games, social media and otherInternet forums, virtual/augmented reality environments, and the like,sometimes referred to as cyberspace. These electronic interactions,whether individual-machine interactions or individual-individualinteractions, increasingly are facilitated by a concept of virtualidentity for each party to the interaction, which may be referred to asan application identity. The virtual identity enables a given party toidentify itself to other entities in an interaction and/or enables otherparties to recognize or identify the given party during the interaction.

A virtual identity can be embodied as simple as a profile, and can bemore complex such as including an avatar or other graphicalrepresentation, a persona (e.g., an aspect of character of the virtualidentity that is presented to or perceived by others), and/or areputation (e.g., beliefs or opinions that are generally held about thevirtual identity). In virtual reality (VR) applications, virtualidentity can be very complex in order to provide a fuller, richeridentity to other entities in VR encounters or other interactions. Avirtual identity can be used to associate application data with a user.For example, a virtual identity can be used to correlate user data,application settings, pictures, and/or profiles with users, among othertypes of application data.

Presently, virtual identities are limited to a single application (e.g.,specific to a given application and nontransferable to otherapplications). That is, a user may create a virtual identity for a givenapplication and that virtual identity is not portable to, or persistentin, a different application. A user must create a separate virtualidentity to use with each of a plurality of applications. As such, theuser may have the burden of managing and/or maintaining a plurality ofvirtual identities. If the user experiences a change (e.g., a change ofname, address, phone number, or the like), or desires to effectuate achange to a virtual identity (e.g. a change of an aesthetic feature suchas an icon), then the user may have the burden of propagating the changethrough a plurality of virtual identities, each corresponding to adifferent application.

As virtual identities grow more complex and detailed (e.g., includinggreater amounts of associated information) the burden on a user may befurther enhanced. For example, if the application identity is associatedwith a virtual application having a visual aspect, then the virtualidentity may include a virtual avatar and other types of data associatedwith the virtual identity. A user may create, manage, and/or maintain adifferent virtual avatar for each of a plurality of virtualapplications. If a user makes a change to an avatar associated with onevirtual identity (e.g., a change of hair color), the user would need tothen make the same change to the avatar associated with each othervirtual identity in which the user may interact. In other words, if auser wants consistent (e.g., identical or similar) virtual identitiesacross multiple applications, then when the user changes the hair color(or most any other visual aspect, such as shape, height, muscledefinition, tattoos, sex, art style, default animation sets) of anavatar (e.g., a bipedal humanoid character) for a given virtual identityin one application the user will also have to make that same change forall other applications in which the user desires the correspondingavatars and/or virtual identities to be consistent.

A persistent virtual identity (e.g., including such aspects as anavatar, persona, reputation, etc.) that is portable across applicationsand/or platforms may be desirable. In some embodiments of the presentdisclosure, a single persistent virtual identity can be created,managed, and maintained for (and may be portable to) a plurality ofapplications, platforms, and/or virtual environments, whether social,business, gaming, entertainment, or any other platform that facilitatesor otherwise wants users to have a visual presence in it.

An application can be a standalone computer program. An application canbe a computer program to perform a group of coordinated functions,tasks, or activities for the benefit of a user. A video game may be anexample of an application. An application that is a standalone computerprogram may optionally include or interact with online or remotelylocated components, such as data stores and cloud computing resources. Aplatform can be a group of different applications, services, and/orcomputing resources that provide a broader service. A platform can be orotherwise provide the environment in which an application is executed,and may include the hardware or the operating system (OS), or otherunderlying software (e.g., the stage on which applications and othercomputer programs can run). A platform may be heavily tied to ordirected to an online functionality, such that the differentapplications, services, and/or computing resources may be distributed,or remotely located and interconnected via a network. A platform canprovide a computing environment for a virtual environment (e.g., avirtual world). A persistent virtual identity can be developed and/oremployed in multiple applications, platforms, and/or virtualenvironments.

Reference is now made to the figures in which like reference numeralsrefer to like elements. For clarity, the first digit of a referencenumeral indicates the figure number in which the corresponding elementis first used. In the following description, numerous specific detailsare provided for a thorough understanding of the embodiments disclosedherein. However, those skilled in the art will recognize that theembodiments described herein can be practiced without one or more of thespecific details, or with other methods or components. Further, in somecases, well-known structures, or operations are not shown or describedin detail in order to avoid obscuring aspects of the embodiments.Furthermore, the described features, structures, or characteristics maybe combined in any suitable manner in one or more embodiments.

FIG. 1 is a system 100 diagram for a persistent virtual identity systemaccording to one embodiment. The system 100 can include 3D content 102,a content conversion system 106, artist tools 108, an asset lookup anddelivery service 110 (and/or library), content standards 114, an assettransfer client 116, a 3D character SDK 118, and a ready room in virtualreality (VR) 120. The system 100 can also include brand modules 112 a,112 b, 112 c, and 112 d (sometimes referred to generally andcollectively as “brand module(s) 112”). The system 100 can include aplurality of applications 122 a, 122 b, 122 c, 122 d (sometimes referredto generally and collectively as “application(s) 122”) As can beappreciated, in some embodiments the applications 122 may be on a singlecommon computing platform (e.g., in a common VR environment). In otherembodiments, one or more on the applications may be on different, uniquecomputing platforms. A user may interact with the system 100 by way of auser interface 124 that interfaces via the applications 122 and/or theready room VR 120. The user interface 124 may be or operate on a usercomputing device. A user of the system 100 may include electronic users,such as a bot or an AI application, in addition to human users.

The system 100 can provide the ability to create and/or maintain apersistent virtual identity and/or a corresponding 3D asset(s), and toenable transport of such between applications (e.g., different games)and/or platforms (e.g., different augmented reality (AR) or VR systems).As used herein, the persistent virtual identity can include a base 3Dasset (e.g., an avatar model and modifications thereto), following 3Dassets (e.g., clothing, accessories, etc.), history associated with auser of the system, social reputations, social standing, inventory,wardrobe (e.g., additional clothing following 3D assets, which mayinclude pre-saved outfits), and/or trophies, among other itemsassociated with the persistent virtual identity. A virtual identity mayinclude multiple 3D assets, which can include one or more base 3D assets(e.g., multiple avatars) and one or more following 3D assets. The 3Dasset(s) can be at least partially defined using geometric data. The 3Dasset(s) can further be presented as an avatar associated with thepersistent virtual identity. For sake of simplicity, a “3D asset”referenced hereafter may be a base 3D asset, a following 3D asset, or acombination of one or more of these.

The applications 122 can be VR applications. The applications 122 can beindependent of each other. The applications 122 can be gamingapplications, social media applications, instructional applications,business applications, and/or any other type of application employing VRtechniques. The brand modules 112 can provide conformity standards forthe applications 122. That is, a 3D asset generated in the system 100can conform to the standards defined by the brand modules 112 to becompatible with the respective applications 122. The applications 122may all be on a single platform (e.g., HTC Vive®, Oculus Rift®,PlayStation VR®), or may be on different platforms.

In some examples, the applications 122 and/or the brand modules 112 canbe external to the system 100. That is, the applications 122 and/or thebrand modules 112 can be implemented independent of the system 100(e.g., separate and distinct from the ready room VR 120, the assetlookup and delivery service 110, and the content standards, 114,although interfacing or otherwise communicating such as through an API).The applications 122 and the brand modules 112 are correlated. Stateddifferently, the brand modules 112 correspond to and provide standards,rules, protocols, and/or the like for the applications 122. For example,the application 122 a is associated with the brand module 112 a, theapplication 122 b is associated with the brand module 112 b, theapplication 122 c is associated with the brand module 112 c, and theapplication 122 d is associated with the brand module 112 d.

The system 100 can enable a persistent virtual identity that is portableand persistent to exist and be transported between the applications 122.A developer and/or a user can integrate or otherwise interconnect withthe system 100 (e.g., via applications 122 and/or user interface 124,and generally over a network) to both create a persistent virtualidentity, and potentially to interact with other persistent virtualidentities created by and corresponding to other users. The user and/orthe application developer can exercise control over the createdpersistent virtual identity. For example, the user can, through the userinterface 124, interconnect with the ready room VR 120 to manipulate thevirtual identity. The user can also manipulate the virtual identitythrough applications 122. FIG. 1 shows the user interface 124interconnected with the system 100 through the ready room VR 120 and theapplication 122 b.

The system 100 can include a three dimensional (3D) character softwaredeveloper kit (SDK) 118 (e.g., an MCS Plugin). The 3D character SDK 118may be a library that can be implemented in an application 122. The 3Dcharacter SDK 118 includes functionality to perform operations likecreate 3D assets (e.g., avatars, in a scene), shape them, add/removeclothing and other following 3D meshes, etc. The 3D character SDK 118also includes functionality to obtain 3D models (for base 3D assets) andaccompanying information from the local cache (and if a 3D model and/oraccompanying information isn't in the local cache, the 3D character SDK118 can transparently fetch the 3D model and/or accompanying informationfrom the cloud). The 3D character SDK 118 can also transform 3D modelsinto game ready objects, namely 3D assets. The 3D character SDK 118 canalso provide other asynchronous operations, which provides an event ortask queue.

The system 100 can also include an asset transfer client 116 (e.g.,ready room plugin) and an asset lookup and delivery service 110 (and/orlibrary). The asset transfer client 116 and the asset lookup anddelivery service 110 can be local and/or remote to the system 100. Thatis, the asset transfer client 116 and/or the asset lookup and deliveryservice 110 can be executed (e.g., hosted) on a network computing deviceremote to the system 100 that can be accessed by the applications 122.As used herein, the asset lookup and delivery service 110 allows theasset transfer client 116 to request a specific 3D asset withpermutations on the request for specific level of detail, material, andtexture variation. The asset lookup and delivery service 110 can alsoprovide (e.g., stream) the 3D asset to the asset transfer client 116. Asused herein, a material may be a combination of texture files, shaders,and different maps that shaders use (normal map, occlusion map) andother data such as specularity and metallic levels depending on thematerial type. A material may be a visual layer that makes somethingwithin a 3D asset look like more than just polygons.

The asset transfer client 116 can include two or more componentsremotely located from each other and communicating together, such asover a network. A first component of the asset transfer client 116 canbe implemented in the user interface 124 and/or the applications 122. Asecond component of the asset transfer client 116 can be implemented inthe system 100. The first component of the asset transfer client 116 cancommunicate with the second component of the asset transfer client 116,for example to request a 3D asset. The component of the asset transferclient 116 implemented in the system 100 can request or otherwise obtainthe 3D asset from the asset client lookup and delivery service 110.

The system 100 can also include the content standards 114 which includesstandards for the brand modules 112 and/or the applications 122. Thecontent standards 114 can specify types of content or groups of contentbased upon the creator of the asset, the genre of the asset, or the artstyle of the asset. The content standards 114 can specify types ofcontent or groups of content through the use of filters. The filters canoperate on metadata associated with the 3D assets comprising the contentor groups of content. The metadata can identify a vendor from which the3D asset originated, a genre of the 3D asset, and an artistic style ofthe 3D asset, among other types of data included in the metadata.

A genre can include, for example a fantasy genre, a science fiction(sci-fi) genre, a comic book genre, and/or contemporary genre, amongother genres. An artistic style can be defined by vendors who create newartistic styles. The system 100 can have a default artistic style suchas a Nikae artistic style and a Minecraft-esque artistic style.

The content standards 114 can also specify what types of 3D assets areallowed in respective applications 122 and/or what types of 3D assetsare not allowed in respective applications 122. For example, the contentstandards 114 can define that 3D assets with a default artistic styleand a fantasy genre are allowed in a given corresponding application 122c and that 3D assets of a different artistic style and a different genreare not allowed in the application 122 c.

The content standards 114 can also specify that 3D assets originatingfrom a particular vendor are allowed in a corresponding application fromthe applications 122. For example, the content standards 114 canrestrict the transfer of 3D assets to the application 122 d to 3D assetsthat were originated by a vendor of the application 122 d.

The content standards 114 can define 3D assets that are restricted fromspecific brand modules 112 and/or applications 122 to maintainconsistent or inconsistent visual effect. The content standards 114 canbe implemented in the asset lookup and delivery service 110 to regulatecontent provided to the applications 122. The content standards 114 canalso be implemented in applications 122 and/or the user interface 124 aspart of the asset transfer client 116 to regulate content downloaded andcached at the applications 122 and/or the user interface 124.

The artist tools 108, the content conversion system 106, and the readyroom VR 120 may be supporting systems to the system 100. Statedotherwise, they may be supplemental and/or ancillary to the system 100,such that they could be implemented separately and distinctly (e.g., ona different computing device, network, or the like) from other elementsof the system 100. The artist tools 108 can modify 3D assets to make the3D assets compatible with the 3D character SDK 118. The contentconversion system 106 can convert the 3D content 102 to be performant(e.g., to perform well, such as within performance metrics) for run timeapplications. The content conversion system 106 can also convert the 3Dcontent 102 to be compatible with the 3D character SDK 118. The 3Dcontent 102 can include, for example, high fidelity photo-real assetsand/or low fidelity game-ready assets. The 3D content 102 can becreated, for example, by a 3D content creator such as a Daz® 3Dapplication.

The ready room VR 120 can be an application. The ready room VR 120 canbe a hub and/or a starting point for persistent virtual identitycreation. The ready room VR 120 can also be a default process for movingpersistent virtual identities between applications.

The 3D character SDK 118 can enable a base figure (e.g., a base 3D assetrepresenting an avatar that is part of a persistent virtual identity, orother base 3D asset) to be changed into any shape and/or size and retainfull functionality for fitting clothing, animating, and/or customizing.Using the 3D character SDK 118, the base 3D asset can be extendable to apotentially unlimited number of variations for creation of a uniqueavatar. Stated otherwise, characteristics of a 3D asset can be modifiedin a potentially unlimited number of combinations of variations. Thenthe system 100 can enable the resultant unique avatar to retain a visualidentity across artistic stylings (e.g., if the application 122 aimplements a first styling, for example a cartoon styling, and theapplication 122 b implements a second styling, for example a realisticstyling, then the unique avatar can retain a visual identity as theavatar is shown in a cartoon styling in the application 122 a and arealistic styling in the application 122 b). The 3D character SDK 118can include a number of modules and/or services for performing specificoperations to modify or otherwise configure characteristics of 3Dassets. For example, the 3D character SDK 118 can include a morphingmodule, a joint center transform (JCT) bone module, a standard shapemodule, a projection module, a head scanning to a dynamic mesh fittingmodule, a heterogeneous mesh behavior module, a hair module, and a smartprops module.

The artist tools 108 is one or more standalone modules, potentiallyincluding computer-readable instructions configured to convert 3D assetsto a form/format compatible with the system 100. The artist tools 108can receive a 3D asset (e.g., geometry), which may be configured in anumber of different formats. The artist tools 108 can be configured togroup the geometry into items; set up the level of details (LODs) for anitem; generate geographical maps (geomaps); add self-defining behavioralinformation to objects for runtime simulation; set up materials andgenerate materials for different platforms; configure the geometries'multilayered characteristics for runtime-optimized multilayer depth andvolumetric preservation between meshes; and/or set up zones on items forheterogeneous mesh deformation (e.g., so that something like metaldeforms differently than cloth to an avatar's shape). As used herein ageomap comprises geometry, a vertex index, and a map outlining anoptimized correlation between a following mesh and base mesh to be usedfor real time calculation and generation of multilayer depth solutionsand/or projection solutions. Projection references the act of projectinga deformer from one mesh to another.

The artist tools 108 also set up the custom shaping of a base 3D assetand set up the 3D assets into specific art styles to allow automaticavatar preservation between art styles. The output of the artist tools108 can be either a single 3D asset and/or a collection of 3D assetswhich can be compatible with the 3D character SDK 118. The 3D assetsmodified by the artist tools 108 can be uploaded to the asset lookup anddelivery service 110. The 3D assets can further be configured at theasset lookup and delivery service 110 for user specified distributionbased upon rules and conditions associated with the 3D asset and asprovided by the brand modules 112.

The ready room VR 120 can be a base application that facilitatesinteraction between a user and the system 100. A base application can bedifferent from the applications 122, such that the base application is astandalone application that can be executed independently from theapplications 122. The user can create and customize a 3D asset via theready room VR 120 using additional content (e.g., following 3D assets)converted with the artist tools 108, made available through the assetlookup and delivery service 110, delivered through the asset transferclient library 116, and passed to the 3D character SDK 118. For example,the user can, via the user interface 124, access the ready room VR 120to create and/or customize a 3D asset and launch at least one of theapplications 122 through the ready room VR 120.

In some examples, the user can create and customize an avatar (orotherwise configure a base 3D asset) via the application 122 b. Forexample the user can access the application 122 b and through theapplication 122 b access the ready room VR 120, or functionality of theready room VR 120 (e.g., to create and customize a 3D asset). Stateddifferently, functionality of the ready room VR 120 may be implementedor otherwise integrated with the application 122 b, such that a user ofthe application 122 b can create and/or customize an avatar or other 3Dassets within the a context of the application 122 b.

The ready room VR 120 can showcase the core functionality of the system100 from an end user's perspective. The ready room VR 120 can provideboth a place to customize a 3D asset, including an avatar, a shapeand/or clothing associated with the 3D asset, and a place to demonstratethe process and/or standards of “walking between applications.” Theready room VR 120 provides multiple means to transfer an identitybetween applications 122, interconnect between multiple open VRapplications 122, and incorporate face scan data onto the avatar. Theready room VR 120 can provide different example implementations of auser interface (UI) for shopping, previewing, and/or checking out ofstores, among different types of checkout processes.

Once compatible content is acquired, a user can use and customize the 3Dasset. A persistent virtual identity for the user can be created, andthen the user can activate a mechanism to allow an acquired and/orcreated 3D asset (e.g., avatar) to transport (e.g., transfer) or stepinto any one of the applications 122. That is, a 3D asset associatedwith a user can retain an identity as the 3D asset transitions from theready room VR 120 into one of the applications 122, and then provide endpoints for the user to return to the ready room VR 120. The virtualidentity of a user, including a corresponding avatar or other 3D asset,can be maintained consistent across multiple applications 122, and asthe virtual identity is transported from one application 122, to theready room VR 120, and/or to another application 122. The 3D asset canalso extract and retain items (e.g., a virtual weapon, or other object3D asset) from the applications 122 that can persist in the ready roomVR 120 as the 3D asset transitions from one of the applications 122 intothe ready room VR 120 and then to another of the applications 122.

The persistent virtual identity can be associated with, andrepresentative of a user that is external to the system 100. A user canbe a human user and/or an automated user.

In some examples, transitioning a 3D asset from a first application(e.g., application 122 a) to a second application (e.g., application 122b) can include conforming to standards set by the second application.The standards can include a specific art style and/or theme.Transitioning a 3D asset from a first application to a secondapplication can include placing the 3D asset in a VR room (e.g., lobby)of the first application 122 a where the user and/or the 3D characterSDK can initiate the required changes to the 3D asset before fullytransitioning the 3D asset to the second application.

The transfer of 3D assets between applications includes configuring a 3Dasset so that the 3D asset's customizations are retained as the 3D assettransitions from one application to a different application, such thatthe settings and status of the 3D asset remain the same. The transfer of3D assets is one example of a persistent virtual identity. The transferof 3D assets can be accomplished by utilizing a local backdoor moduleand/or a remote restore module. These modules enable the transfer of anidentity between applications 122.

The local backdoor module can include an application 122 a calling theasset transfer client 116 to export a 3D asset (e.g., a 3D asset file)and/or a persistent virtual identity (e.g., an identity file) comprisinggeometry, skinning, rig, textures, materials, and shaders of the current3D asset with associated items in use, and/or any additional metadatadescribing the 3D asset and/or persistent virtual identity. After theexport is finished, the application 122 a launches the application 122 bwith reference to the local identity file, and then shuts itself down.The application 122 b can access the identity and request the localidentity definition from the asset transfer client 116 and load theidentity into the application 122 b.

The remote restore module can be configured to cause the application 122a to call the asset transfer client 116 to push the identity definitionmetadata to the asset lookup and delivery service 110. The application122 a can then launch the application 122 b with an identity string, andthen shut itself down. The application 122 b can request that the assettransfer client 116 call the asset lookup and delivery service 110requesting the identity string. The application 122 b can likewiseretrieve metadata associated with the persistent virtual identity. Theapplication 122 b can use either local 3D assets (e.g., locally stored)or remote 3D assets (e.g., streamed or otherwise provided or accessedfrom a remote location) to render the avatar.

In some examples, the asset transfer client 116 can comprise one or morecomponents. For example, the asset transfer client 116 can comprise aclient and a server. The client can be implemented in the applications122 and/or computing devices on which the applications 122 areexecuting. The server of the asset transfer client 116 can beimplemented in the system 100. The client can communicate with theserver to transfer a 3D asset from the system 100 to the computingdevice of the applications 122.

To transfer a 3D asset and/or persistent virtual identity betweenapplications, the user can select a destination application 122 b from asource application 122 a. Once selected, a gate or portal may begenerated within the source application 122 a. The source applicationmay portray the gate and/or portal as a visual appearance branded forthe destination application 122 b. The gate and/or portal may transitionthe 3D asset and/or persistent virtual identity from the sourceapplication 122 a to virtual space (e.g., referred to as the “airlock”)that is configurable and customized by the destination application 122 b(e.g., a destination application vendor and/or the corresponding brandmodule 112 b). The mechanism to trigger the transfer of a 3D asset mayinclude walking and/or other locomotion methods within a VR environmentprovided by the source application 122 a toward the gate or portal ofthe destination application 122 b.

The transferring of the 3D asset and/or the persistent virtual identityfrom source application to the virtual space through the virtual portalmay trigger a VR passport check. The VR passport check compares clothingand/or an art style associated with the 3D asset and/or the persistentvirtual identity with vendor specific standards of the destinationapplication 122 b. If the 3D asset and/or persistent virtual identitydoes not conform to the destination application 122 b, then the user isprovided an opportunity to change clothing, art style, or any otheraspect associated with the 3D asset and/or persistent virtual identity,to meet the destination application standards. Once the standards aremet, a launch mechanism, through another virtual portal, the pushing ofa button, or the act of meeting the standards, will initiate a transferof the 3D asset and/or the persistent virtual identity between thesource application 122 a and the destination application 122 b.

A set of standards between applications 122 and vendors can be defined.The standards can foster an increased level of persistence and transferto exist between different applications 122. The standards enableenhanced functionality to allow standard behavior and transfer of assetsor mechanics between disparate applications 122. For example, anapplication agnostic content interchange can be defined to facilitatethe association between 3D assets and/or persistent virtual identitiesand a given application 122 a (e.g., a source application 122 a) and thetransfer of the persistent virtual identity to other applications 122(e.g., a destination application 122 b). Transferring the persistentvirtual identity and/or 3D asset can include losing permanence in thesource application 122 a and creating permanence in the destinationapplication 122 b with a conforming set of behaviors, mechanics, andappearances.

In some examples, face scan data can be associated with a dynamic mesh.Associating scan data with a dynamic mesh can include taking face scandata and changing a base figure, associated with the 3D asset and/orpersistent virtual identity, to incorporate the face scan data such thatthe base figure retains the same mesh topology while retainingfunctionality for further shaping of the mesh (e.g., making the facenarrower, nose larger, ears pointed, etc.).

The face scan data can be placed on a dynamic mesh. The face scan datacan be 3D scanner generated and/or photogrammetry generated (e.g., meshand texture). The face scan data can also be generated using variousimages and/or other means. Placing the face scan data on a dynamic meshcan deform the base figure associated with a 3D asset and/or persistentvirtual identity to match the visual appearance of the face scan data.Placing the face scan data on a dynamic mesh can generate texture tomatch the face scan data on the base figure associated with the 3Dassets and/or persistent virtual identity.

The face scan data can be compared with the base figure to identifywhere key facial and head landmarks are on both sets of data (e.g., facescan data and base figure and/or base 3D asset). The base meshassociated with the base figure is deformed to the same shape as theface scan data using automated adjustments of existing blend shapes foreach key region of the face. In some examples, a new blend shape can begenerated for the base figure to match the face scan data. The face scangenerated texture can be analyzed and, using key face and headlandmarks, the texture can be rebuilt to fit the base figure's UV map.The face scan generated texture can comprise multiple texture files. Themultiple texture files can be combined into a single texture file forthe head of a base figure. Fitting face scan data to a base figure canbe performed using a custom rig and geomap technology to compare andmatch the base figure mesh to the face scan data. As used herein, blendshaping, morphing, and deforming references a set of data attached to amesh which contains positional deltas on geometry and bones to allow themesh to change shape while not changing its fundamental geometry and/orrig.

When configuring an avatar, if there is face scan data associated withthe 3D asset and/or the application identity associated with the 3Dasset, the ready room VR 120 can associate the face scan data with the3D asset such that the 3D asset retains the full customization andcompatibility of the base figure without any scanned data. As such, a 3Dasset can be configured with the face scan data. The face scan data canbe provided, by the user, by uploading a mesh to a server associatedwith system 100 through at least one of a web form or mobileapplication.

As used herein, the system 100 can be implemented in a single computingdevice and/or over a plurality of computing devices. For example, eachof the components of the system 100 can be implemented using independentcomputing devices coupled via a network. In some examples, the system100 can be implemented using cloud services.

FIG. 2 is a block diagram of an asset transfer client 216 according toone embodiment. The asset transfer client 216 can receive a 3D assetfrom the asset lookup and delivery service 210. The asset transferclient 216 can comprise an asset query module 230, filters 232, personadefinition module 234, assets 236, and an asset fetch module 238.

The asset transfer client 216 can process the communications (e.g.,messages) between remote services and the local handling of assets(e.g., local to the applications 122 in FIG. 1). The asset transferclient 216 can operate independently of the 3D character SDK 118 in FIG.1 as the asset transfer client 216 is generic, is not tied to anyspecific 3D engine, and provides an application program interface (API)and/or local service for the 3D character SDK 118 to call against toobtain 3D assets. That is, a client of the asset transfer client 216 cancommunicate with a server of the asset transfer client 216 to obtain 3Dassets that can then be passed to a 3D character SDK 118. The 3Dcharacter SDK 118 can also include a client implemented in the computingdevice of the applications 122 and a server implemented in the system100 in FIG. 1.

The logical paths in the asset transfer client 216 can perform an assetquery via the asset query module 230 and/or an asset filter via thefilters 232. The logical paths in the asset transfer client 216 can alsoaccess a list of details associated with a 3D asset (e.g., an avatar)via the persona definition module 234. The asset transfer client 216 canalso access a specific 3D asset via the asset module 236 and decryptand/or cache the 3D asset locally. As used herein, decrypting and/orcaching a 3D asset locally can include receiving an encrypted 3D assetfrom the identity system (e.g., system 100 in FIG. 1), decrypting the 3Dasset, re-encrypting the 3D asset using a key unique to the user,application, and/or associated computing device, and storing there-encrypted 3D asset. Examples of the functionality built into thosetwo paths include, but are not limited to, the following: authenticationof accounts globally and per vendor channel; encryption and decryptionof 3D assets; querying of assets for what is available for vendorchannels or for what matches user inputted criteria; reading andupdating identity definitions; caching and handling local caching of 3Dassets; and shopping and purchasing 3D assets.

The asset transfer client 216 can run as a compiled against library aspart of the application and/or as a local service that handles calls.The asset transfer client 216 can process communications, across allapplications, with the asset lookup and delivery service 210, localdownload and storage of 3D assets, and local caching strategies to allowa single download of a 3D asset which is then useable by allapplications that request the 3D asset. The asset transfer client 216can register a new account, create a new identity, update avatarsettings, update social rating and reputation data, retrieve a list ofcontent that is associated to an avatar, retrieve a list of potentiallywearable content (e.g., following 3D asset) that is available throughthat application, store requests, download content requests, streamcontent requests, and any other remote calls that might need to be made.

As previously described, the asset transfer client 216 may include twological paths of communication for querying for assets. The two paths ofcommunication are a general asset query module 230 and a personadefinition module 234. The query module 230 can be used for listing andretrieving metadata and details about 3D assets that are availablethrough the brand modules 112 in FIG. 1, and queries that are specificto the avatar and/or a persistent virtual identity comprising a personadefinition as defined by the persona definition module 234. The assetquery module 230 provides a list of queries that then get passed to thefilter module 232. The filter module 232 allows the 3D assets to besorted and filtered by various data types. The various data types caninclude, for example, genre, base figure, clothing type, vendor, etc.The persona definition module 234 can store data about a persistentvirtual identity and specifically what virtual objects an avatar,associated with the 3D asset, can use and is currently using. Thepersona definition module 234 can define, for example, a username,clothing associated with the 3D asset, and/or social reputationassociated with the persistent virtual identity.

Both of the paths feed to the asset service or asset module 236, whichtracks the requests to eliminate duplicate requests. The asset module236 can also pass the request to the asset fetch module 238. The assetfetch module 238 can identify local content versus remote content, andas necessary download, decrypt and re-encrypt content against thedownloading account. The asset fetch module 238 can also provide thecontent to the requesting plugin (e.g., the 3D character SDK 118) andrun any cache cleanup routines as necessary.

FIG. 3 is a block diagram of an asset lookup and delivery service 310according to one embodiment. The asset lookup and delivery service 310can include an admin module 342, a ready room cloud module 348, a storemodule 350, and a content delivery network 352. The asset lookup anddelivery service 310 can be in communication with the asset transferclient 316.

The asset lookup and delivery service 310 can be a remote hypertexttransfer protocol (HTTP)/2.0 over a secure socket layer (SSL) basedapplication. The asset lookup and delivery service 310 can includeneeded end points for the asset transfer client 316 to enablecommunication between the asset lookup and delivery service 310 and theasset transfer client 316. The asset lookup and delivery service 310 caninclude an admin module 342 comprising administrative graphical userinterfaces (GUIs) for managing the identity system 100 and forindividual vendors to manage content and stores within or associatedwith the system 100.

For example, the admin module 342 can include an internal admin module344 to provide vendor setup capabilities and reporting capabilities. Theadmin module can also include a vendor admin module 346 to providevendor-to-vendor capabilities and vendor-to-user capabilities. Thevendor-to-vendor capabilities can include dress code enforcement andrestricted internet protocol (IP) enforcement. The vendor-to-usercapabilities can include criteria based access.

Additionally, the asset lookup and delivery service 310 provides thedata collection point for a cross application social and reputationsystem to additionally add a way to have a level of persistence on theactions associated with a user and/or a persistent virtual identity. Theasset lookup and delivery service 310 can also define an access thatusers and/or vendors have to a data collection point including thereputation data. The asset lookup and delivery service 310 can alsoinclude a rating system, for user ratings of vendors, with configurablevendor settings to give input and/or weight to social reputation.

The asset lookup and delivery service 310 can be divided into threesubsystems: store module 350 (e.g., store API), content delivery network(CDN) 352, and ready room cloud module 348. The ready room cloud module348 can comprise an API for the asset lookup and delivery service 310.The ready room cloud module 348 can authorize the manipulation of 3Dassets, can save and/or load the state of a 3D asset, can determine avisual description of a 3D asset, and can rate interactions with theuser interface 124 and/or applications 122 (see FIG. 1). Each of thesubsystems can be accessed independently from each other. The storemodule 350 provides shopping and purchasing functionality such as avendor restricted list and a checkout module. The checkout module canprovide checkout functionalities associated with a financialtransaction. The CDN 352 provides a fast and optimized asset lookup anddelivery of assets, along with streaming support. The ready room cloudmodule 348 provides the functionality to support either the assettransfer client library 316 and/or the admin module 342 (e.g.,administrative UI).

In some examples, the asset lookup and delivery service 310 can be aremote service to upload content prepared by the artist tools. The assetlookup and delivery service 310 can be configured to stream the contentprepared by the artist tools to the clients (e.g., applications 122). Aspreviously described, the asset lookup and delivery service 310 canprovide the internal admin module 344 and the vendor admin module 346that interact with the admin module 342. Data and assets can be passedfrom the admin module 342 to the ready room cloud module 348, whichmarshals the data to be sent either directly down to clients asrequested or passed onto the store module 350 and/or the CDN 352 to passdown to end clients including the asset transfer client library/service316 implemented in associated applications.

The internal admin module 344 initiates and monitors systems andvendors. The internal admin module 344 can provide insight into metricssuch as number of users and load across the system, set up and managevendors, configure global shopping parameters, and/or generate reportsacross the system.

The vendor admin module 346 uploads and manages 3D assets. The vendoradmin module 346 provides a user the ability to upload 3D assets,configure the 3D assets for any additional data needed, allow 3D assetsto be set up (for purchase or free) default associations of users thatconnect to their brand module, and allow users to set up access controllists (ACLs) (e.g., restrict IP) for 3D assets and dress code standardsthat their brand module enforces. The ACLs allow a vendor to set up whatcontent from other brand modules is allowed in and what content to whatbrand modules the content for this brand module is allowed to beconsumed in. This allows a high degree of control for a vendor to makesure items to be loaded into their application are appropriate,stylistically fitting, and on brand as desired. The dress code standards(e.g., VR passport) additionally allow a vendor to put restrictions onwhat can be used or worn in their application and if there are requiredartistic styles.

The admin module 342 is the data store and logical component thathandles the processing and prepping of the content (e.g., 3D assets),serving largely as the systemic point of authority. The admin module 342provides 3D assets and associated data for distribution. For example,the admin module 342 may provide a 3D asset over a network, such as acontent delivery network (CDN) for delivery to the ready room VR 120 oran application 122 facilitated by the asset transfer client 116. Theadmin module 342 takes uploaded 3D assets from the artist tools 108,reprocesses and breaks that 3D asset into a more streaming optimalformat, and makes it available to download (e.g., on a public facingURL) that a ready room 120 or an application 122 can authenticate todownload.

The ready room cloud module 348 can receive data in a per vendor viewfrom the admin module 342 to allow fast queries for data and asset setsspecific to what a vendor allows. The ready room cloud module 348 passesdata specific to store functionality (e.g., shopping, previewing, and/orcheckout) to the store module 350. The ready room cloud module 348 alsoprovides the data to the CDN 352 to handle asset resolution andstreaming of assets. The CDN 352 downloads assets for different LODlevels or different material presets programmatically. Other client APIrequests can be processed by the ready room cloud module 348 to processdata about individual identities, to determine what content is beingcurrently used by at least one of the CDN 352 and the ready room cloudmodule 348, and to determine an access that the CDN 352 and/or the readyroom cloud module 348 have to 3D assets.

FIG. 4 is a block diagram of a 3D character SDK 418 according to oneembodiment. The 3D character SDK 418 comprises a physics module 474, amiscellaneous module 476, a network module 478, and a body module 480.

The 3D character SDK 418 provides a list of independent functionalitiesand calls to drive the content in specific ways. The 3D character SDK418 can be used to fit clothes on a 3D asset, generate deformations ofthe 3D asset, transition between art styles, transform bone structuresassociated with the 3D asset, and/or affect heterogeneous mesh behavior,rigidity, and/or hair.

For example, rigidity and/or hair associated with a 3D asset can beconfigured via the physics module 474. Resource management and propsassociated with the 3D asset can be configured via the miscellaneousmodule 476. The streaming support, the avatar loading/exporting, theready room fetch, the ready room asset queue, and/or the pre-populationfilters can be configured via the network module 478. The morphing, thebone structure, the head/body scanning, the standard shapes, and/or theprojection associated with a 3D asset can be configured via the bodymodule 480. The 3D character SDK 418 can perform specific tasks withouta specific flow or process across the 3D character SDK 418.

The network module 478 includes a subset of network calls to pull downor push up data. Streaming support is a custom 3D file format optimizedfor streaming data and is platform agnostic. Avatar load/export includescalls for loading in an avatar definition, saving an avatar definition,and exporting an avatar to a different application. RR Fetch and RRasset queue go hand in hand in that RR Fetch fetches assets by puttingthem into an asynchronous RR asset queue for streaming down, caching,and loading in of assets from the web to a local location, so that, oncedownloaded, they can be accessed quickly from a hot or warm cache.Pre-population filters may include application filters that differentqueries are automatically filtered by so that only content that anapplication allows to come in will get sent from the network SDK.

The body module 480 includes operations to modify an appearance of a 3Dasset. Morphs are the delta change of the vertices, also known as blendshapes, that shapes the geometry to different orientations, so goingskinny to fat is through these. Bones are bits of 3D data that may beanalogous to a skeleton that vert influence levels are associated withand that allow the movement and animation of a 3D asset (e.g., a figureor avatar). Head/body scanning is an example of new technology of takingscan data and generating morphs and materials to match it so it fitswithin the system and rig instead of generating all new 3D data.Standard shapes may enable theme swapping of a standard set of shaping.Projection relates to runtime projection and mapping.

FIG. 5 is a flow diagram of a method 500 for stacking multiple meshesaccording to one embodiment. The method 500 may be performed by a 3Dcharacter SDK, such as described above. The method 500 may also beperformed in any rendering system configured to render 3D contentcomprising a base 3D asset and one or more following 3D assetsconfigured as layers (e.g., stacked meshes). In still other embodiments,the 3D character SDK may be a plugin (e.g., an MCS plugin) to a rendereror rendering system. The method 500 may be repeatedly performed duringruntime, such as during and/or throughout an animation process, to limit“poke-through” of layers (that should be occluded) during a rendering ofmovement of a 3D asset (e.g., a unique figure or avatar comprising abase 3D asset and one or more following 3D assets as layers, such asclothing, on the base 3D asset). For example, a rendering system mayrepeatedly perform the method 500 during runtime of a rendering process.The method 500 may make runtime decisions about mesh layer occlusion, aswill be explained.

In some embodiments, multiple meshes of a 3D asset can be stacked on topof each other in layers while preserving the relative volume andordering of the polygons to prevent poke-through of one mesh pastanother mesh. The multiple meshes of the 3D asset can also be stacked ontop of each other to preserve relative depth of the meshes along everypoint in the overall mesh. “Overall mesh” references the combination ofthe multiple meshes. “Stacking meshes on top of each other” referencesplacing the meshes next to each other. The stack of meshes can includeat least an inner mesh and an outer mesh. The outer mesh can be referredto as a top mesh. The inner mesh can be a mesh that is closest to themiddle of a 3D asset. In FIG. 5, reference to a mesh can include areference to an associated 3D asset, and reference to a 3D asset caninclude a reference to the associated mesh.

For example, if the 3D asset comprises a human figure (e.g., a base 3Dasset) wearing a dress shirt, a vest, and a suit coat (e.g., followingassets), then an inner mesh can describe the human figure, a next meshcan describe the dress shirt, a next to outer mesh can describe thevest, and an outer mesh can describe the suit coat. In some examples,the dress shirt mesh can be prevented from poking through and beingvisible through the vest mesh and/or the suit coat mesh. The suit coatmesh can also be prevented from poking into the vest mesh, the shirtmesh, and/or the human figure mesh. That is, visual discrepancies can beprevented where one mesh is visually going through a different mesh.

A geomap of a 3D asset can be used to identify what portions of thestacked meshes are occluded and what portions of the stacked meshes arevisible. In some examples, the geomap can define a plurality of meshesand an order of the meshes. A mesh can define polygons that compose the3D asset. In some examples, each of the meshes can define a single 3Dasset, or all of the meshes can define a single 3D asset.

An occlusion index of a top mesh of a 3D asset can identify polygons ofthe base mesh which are fully occluded, partially occluded, and/ornon-occluded (e.g., visible) in view of an outer mesh (e.g., mesh thatis next to and on top of the base mesh). The occlusion index can be usedto generate a list of polygons that are not rendered (e.g., fullyoccluded), a list of rendered polygons that are available for additionalprocessing (e.g., partially occluded), and a list of polygons that arerendered and do not require additional processing (e.g., non-occluded).

The method of FIG. 5 provides and describes a top-down approach tostacking multiple meshes. The 3D assets and associated meshes can beloaded 541 from a character definition. The character definition can beaccessed at the applications 122 and/or the ready room VR 120 using theasset transfer client 116 of FIG. 1 (and/or the asset transfer client216 in FIG. 2). The character definition can also be accessed at theapplications 122 and/or the ready room VR 120 using the 3D character SDK118 of FIG. 1 (and/or the 3D character SDK 418 in FIG. 4). That is, theapplications and/or the ready room VR can request a character definitionof a 3D asset and/or a virtual identity from a client asset transferclient that is part of the applications and/or the ready room VR. Theclient asset transfer client can request the character definition fromthe server asset transfer client. The server asset transfer client canrequest the character definition from the asset lookup and deliveryservice. In some examples, the asset lookup and delivery service canprovide an identity, a 3D asset, and/or a character definition of the 3Dasset.

The character definition can describe the 3D assets and associatedmeshes that comprise a character. The 3D assets and/or the meshes can beordered. For example, the character definition can comprise a base 3Dasset, a middle 3D asset, and an outer 3D asset. Each 3D asset and/orassociated mesh can have a depth index that represents a relative depthof the 3D asset and/or the mesh as compared to the other 3D assetsand/or meshes. The depth values are specific to the 3D assets and/ormeshes described in the character definition.

The number of 3D assets and/or meshes that can be stacked on top of eachother is unlimited. Stacking the meshes of the 3D assets can includeiterating over the 3D asset and/or meshes in a linear fashion to stackthe meshes.

In this example, the base 3D asset and/or base mesh can have a depth ofzero. The middle 3D asset and/or middle mesh can have a depth of 1. Thetop 3D asset and/or the top mesh can have a depth of 2. The assigning ofdepth values can occur when the meshes and/or 3D assets are loaded tothe applications and/or ready room VR and does not need to happen everyframe render at the applications and/or the ready room VR.

The 3D assets and/or meshes can be sorted 543 by depth. The highestdepth value represents a topmost layer, and the lowest depth value canrepresent a base layer. The base 3D asset and/or the base mesh has adepth value equal to zero.

A highest depth of an unprocessed mesh can be identified 545. In a firstiteration of identifying 545 the topmost unprocessed mesh, the top meshis identified as the highest mesh that is unprocessed. The occlusion mapof the top mesh can be compared with the occlusion map of the middlemesh. The occlusion map can describe whether the polygons that comprisea mesh are occluded, partly occluded, or non-occluded.

Shared polygons (e.g., spatially shared) between the top mesh and themiddle mesh can be identified 547. A shared polygon may be a portion ofa mesh (e.g., all or a portion of a polygon) that is within the borderof the mesh and also within the border of another mesh as the two mesheswould be positioned during rendering. In other words, a shared polygonmay be spatially shared in that the polygons would exist within the samespatial area and need depth preservation correction. Shared polygons ofstaked meshes Both meshes include a common area or polygon that isoverlapping were both meshes rendered together. A shared polygon mayalso be a polygon (or shape) within the border of a mesh that is atleast partially overlapping with a polygon within the border of anothermesh. A mesh may be a list of vertices and polygons of a 3D asset. Thevertices are a list of points in 3D space, and a list of polygons is alist of how those vertices are connected to each other forming eithertriangles or quadrilaterals. The shared polygons are identified 547 inorder to determine which polygons would be covered by another mesh, tobe able to hide or removing those, or those that are partially coveredand either partially hiding, partially occluding, or modifying them sothat they fit within the proper bounds. So, if you have a shirt andjacket, and the shirts sleeves bulges out, it would normally pokethrough the arms of the jacket and you would see the shirt coming out ofthe middle of the jacket which doesn't look realistic or accurate. Thedisclosed embodiments may identify 547 all the areas of the shirt thatwould normally be covered by the jacket and hides those areas, withspecial handling of edges where you might legitimately see both at thesame time.

The identifying 547 of shared polygons may use a geomap, both vert listsand the per pixel map to the base mesh. The method 500 identifies whichpolygons on the base mesh both following geometries overlap, and thatdetermines that those following geometries are stacked or partiallystacked on top of each other in those areas and the polygon on the lowerdepth level needs to be hidden 549.

The shared polygons of the middle mesh can be hidden 549. Hiding 549 apolygon can include setting a value of the occlusion map correspondingto the shared polygon of a mesh to a fully occluded value and/or apartially occluded value. A polygon that is associated with an occludedvalue can be ignored and not rendered. Setting an occlusion value of anocclusion map of a mesh constitutes processing the mesh. As such, themiddle mesh is processed to prevent polygons from poking through the topmesh.

It can be determined 551 whether there are more unprocessed meshes. Ifso, then a second iteration of identifying 545 a highest-depthunprocessed mesh can be performed. The second iteration can compare themiddle mesh to the base mesh and hide 549 polygons of the base mesh thatare shared with the middle mesh.

If it is determined 551 that there are no more unprocessed meshes, thena fragment shader can be applied 553. Partially occluded polygons can berendered with a custom fragment shader. The fragment shader can utilizealpha injection masks to render the parts of a polygon that are coveredby such an alpha injection mask and to make transparent the parts of thepolygon that are not covered by such an alpha injection mask. Thisallows for an effective partial rendering of polygons for edge polygonsso that the polygons stop and start on the edges of the following 3Dasset or the base 3D asset that do not line up with the edge of apolygon on the higher-depth following 3D asset.

In this manner a rendering system may repeatedly make runtime decisionsabout mesh layer occlusion to limit deeper mesh layers from protrudingthrough outer mesh layers during rendering of an animation of a 3Dasset.

FIG. 6 is a block diagram for a method 600 of stacking multiple meshesaccording to one embodiment. FIG. 6 describes a bottom-up approach tostacking multiple meshes. The method 600 may be performed by a 3Dcharacter SDK, such as described above. The method 600 may also beperformed in any rendering system configured to render 3D contentcomprising a base 3D asset and one or more following 3D assetsconfigured as layers (e.g., stacked meshes). In still other embodiments,the 3D character SDK may be a plugin (e.g., an MCS plugin) to a rendereror rendering system. The method 600 may be repeatedly performed duringruntime, such as during and/or throughout an animation process, to limit“poke-through” of layers (that should be occluded) during a movement ofa 3D asset, such as a unique figure or avatar. The rendering system mayrepeatedly perform the method 600 during runtime of a rendering process.The method 600 may make runtime decisions about mesh layer occlusion, aswill be explained.

The 3D assets and/or associated meshes can be loaded 655 from acharacter definition. In FIG. 6, the character definition can comprise abase 3D asset, a middle 3D asset, and an outer 3D asset. Each 3D assetand/or associated mesh can have a depth index that represents a relativedepth of the 3D asset and/or the mesh as compared to the other 3D assetsand/or meshes. The depth values are specific to the 3D assets and/ormeshes described in the character definition.

In this example, the base 3D asset and/or base mesh can have a depth ofzero. The middle 3D asset and/or middle mesh can have a depth of 1. Thetop 3D asset and/or the top mesh can have a depth of 2.

The 3D assets and/or meshes can be sorted 657 by depth. The highestdepth value represents a topmost layer, and the lowest depth value canrepresent a base layer. The base 3D asset and/or the base mesh has adepth value equal to zero.

Each polygon in the base 3D asset and/or base mesh can be iterated 659over to determine the occlusion index for each following asset wherethere is a shared polygon. The shared polygons between a base mesh, themiddle mesh, and/or the top mesh can be identified 661. Shared polygonsin the base mesh and/or the middle mesh can be hidden 663 by marking theshared polygons in the base mesh and/or the middle mesh as fullyoccluded. If the shared polygons are marked as partially occluded, thenthe shared polygons are placed in a list for a given asset.

Partially occluded polygons can be rendered with a custom fragmentshader. The fragment shader can be applied 665 to the meshes with analpha injection map. The fragment shader can utilize alpha injectionmasks to render the parts of a polygon that are covered by such a maskand to make transparent the parts of the polygon that are not covered bysuch a mask. This allows for an effective partial rendering of polygonsfor edge polygons so that the polygons stop and start on the edges ofthe following 3D asset or the base 3D asset that do not line up with theedge of a polygon on the higher-depth following 3D asset.

In this manner a rendering system may repeatedly make runtime decisionsabout mesh layer occlusion to limit deeper mesh layers from protrudingthrough outer mesh layers during rendering of an animation of a 3Dasset.

FIG. 7 is a block diagram of an identity system according to oneembodiment The mobile device identity system 781 can generate apersistent virtual identity that can be transferred betweenapplications, potentially on different application systems 722. Theidentity system 781 can include a memory 720, one or more processors793, a network interface 794, an input/output interface 795, and asystem bus 796. The identity system 781 may be the similar to oranalogous to the interface system 100 in FIG. 1. The identity system 781may interface with one or more VR application systems 722 via acommunication network 12. The identity system 781 may provide persistentvirtual identity for the VR application systems 722. The identity system781 may also interface with one or more content creation applicationsystem 756 to obtain 3D assets.

The one or more processors 793 may include one or more general purposedevices, such as an Intel®, AMD®, or other standard microprocessor. Theone or more processors 793 may include a special purpose processingdevice, such as ASIC, SoC, SiP, FPGA, PAL, PLA, FPLA, PLD, or othercustomized or programmable device. The one or more processors 793 canperform distributed (e.g., parallel) processing to execute or otherwiseimplement functionalities of the presently disclosed embodiments. Theone or more processors 793 may run a standard operating system andperform standard operating system functions. It is recognized that anystandard operating systems may be used, such as, for example, Microsoft®Windows®, Apple® MacOS®, Disk Operating System (DOS), UNIX, IRJX,Solaris, SunOS, FreeBSD, Linux®, ffiM® OS/2® operating systems, and soforth.

The memory 720 may include static RAM, dynamic RAM, flash memory, one ormore flip-flops, ROM, CD-ROM, DVD, disk, tape, or magnetic, optical, orother computer storage medium. The memory 720 may include a plurality ofprogram engines 782 (and/or modules) and program data 788. The memory720 may be local to the identity system 781, as shown, or may bedistributed and/or remote relative to the identity system 781.

The program engines 782 may include all or portions of other elements ofthe system 781. The program engines 782 may run multiple operationsconcurrently or in parallel with/on the one or more processors 793. Insome embodiments, portions of the disclosed modules, components, and/orfacilities are embodied as executable instructions embodied in hardwareor in firmware, or stored on a non-transitory, machine-readable storagemedium, such as the memory 720. The instructions may comprise computerprogram code that, when executed by a processor and/or computing device,cause a computing system (such as the processors 793 and/or the identitysystem 781) to implement certain processing steps, procedures, and/oroperations, as disclosed herein. The engines, modules, components,and/or facilities disclosed herein may be implemented and/or embodied asa driver, a library, an interface, an API, FPGA configuration data,firmware (e.g., stored on an EEPROM), and/or the like. In someembodiments, portions of the engines, modules, components, and/orfacilities disclosed herein are embodied as machine components, such asgeneral and/or application-specific devices, including, but not limitedto: circuits, integrated circuits, processing components, interfacecomponents, hardware controller(s), storage controller(s), programmablehardware, FPGAs, ASICs, and/or the like. Accordingly, the modulesdisclosed herein may be referred to as controllers, layers, services,engines, facilities, drivers, circuits, and/or the like.

The memory 720 may also include program data 788. Data generated by thesystem 781, such as by the program engines 782 or other modules, may bestored on the memory 720, for example, as stored program data 788. Thestored program data 788 may be organized as one or more databases. Incertain embodiments, the program data 788 may be stored in a databasesystem. The database system may reside within the memory 720. In otherembodiments, the program data 788 may be remote, such as in adistributed computing and/or storage environment. For example, theprogram data 788 may be stored in a database system on a remotecomputing device.

The input/output interface 795 may facilitate interfacing with one ormore input devices and/or one or more output devices. The inputdevice(s) may include a keyboard, mouse, touch screen, light pen,tablet, microphone, sensor, or other hardware with accompanying firmwareand/or software. The output device(s) may include a monitor or otherdisplay, printer, speech or text synthesizer, switch, signal line, orother hardware with accompanying firmware and/or software.

The network interface 794 may facilitate communication with othercomputing devices and/or networks and/or other computing and/orcommunications networks. The network interface 794 may be equipped withconventional network connectivity, such as, for example, Ethernet (IEEE802.3), Token Ring (IEEE 802.5), Fiber Distributed Datalink Interface(FDDI), or Asynchronous Transfer Mode (ATM). Further, the networkinterface 794 may be configured to support a variety of networkprotocols such as, for example, Internet Protocol (IP), Transfer ControlProtocol (TCP), Network File System over UDP/TCP, Server Message Block(SMB), Microsoft® Common Internet File System (CIFS), Hypertext TransferProtocols (HTTP), Direct Access File System (DAFS), File TransferProtocol (FTP), Real-Time Publish Subscribe (RTPS), Open SystemsInterconnection (OSI) protocols, Simple Mail Transfer Protocol (SMTP),Secure Shell (SSH), Secure Socket Layer (SSL), and so forth.

The system bus 796 may facilitate communication and/or interactionbetween the other components of the system, including the one or moreprocessors 793, the memory 720, the input/output interface 795, and thenetwork interface 794.

As noted, the interface system 781 also includes various program engines782 (or modules, elements, or components) to implement functionalitiesof the system 781, including an asset transfer client engine 783, anasset lookup and delivery service engine 784, an artist tools engine785, a 3D character SDK engine 786, and/or a ready room VR engine 787.These elements may be embodied, for example, at least partially in theprogram engines 782. In other embodiments, these elements may beembodied or otherwise implemented in hardware of the system 781. Thesystem 781 also includes identity data 789 and 3D asset data 790 thatmay be stored in the program data 788 which may be generated, accessed,and/or manipulated by the program engines 782.

EXAMPLE EMBODIMENTS

The following are some example embodiments within the scope of thedisclosure. In order to avoid complexity in providing the disclosure,not all of the examples listed below are separately and explicitlydisclosed as having been contemplated herein as combinable with all ofthe others of the examples listed below and other embodiments disclosedhereinabove. Unless one of ordinary skill in the art would understandthat these examples listed below (and the above disclosed embodiments)are not combinable, it is contemplated within the scope of thedisclosure that such examples and embodiments are combinable.

Example 1

A 3D content rendering system, comprising: electronic memory to store a3D asset including a first mesh and a second mesh; and one or moreprocessing units configured to: load the first mesh and the second meshfrom a character definition; identify a lowest depth mesh of the firstmesh and the second mesh, the lowest depth mesh being closer to a centerof the 3D asset; identify shared polygons from the first mesh and thesecond mesh; and hide the shared polygons of the lowest depth mesh, suchthat hidden shared polygons are not presented to be perceived by a userduring rendering of the 3D asset.

Example 2

The 3D content rendering system of example 1, wherein the first mesh isa mesh of a base 3D asset and the second mesh is a mesh of a following3D asset.

Example 3

The 3D content rendering system of example 1, wherein the first mesh isa mesh of a following 3D asset that is associated with a base 3D assetand the second mesh is a mesh of another following 3D asset of the base3D asset.

Example 4

The 3D content rendering system of example 2 or 3, wherein the base 3Dasset is a bipedal humanoid character, and the following 3D asset is anarticle of clothing.

Example 5

The 3D content rendering system of example 1, wherein shared polygonsfrom the first mesh and the second mesh are identified using a geomapthat identifies a plurality of meshes and an order of the meshes,including the first mesh and the second mesh.

Example 6

The 3D content rendering system of example 1, wherein the first meshdefines a first set of polygons and the second mesh defines a second setof polygons and shared polygons are at least partially overlapping.

Example 7

The 3D content rendering system of example 1, wherein the one or moreprocessing units are further configured to electronically provide the 3Dasset, including the first mesh and the second mesh, for presentation ona display.

Example 8

The 3D content rendering system of example 1, further comprising anelectronic display for rendering 3D content, wherein the one or moreprocessing units are further configured to electronically provide the 3Dasset, including the first mesh and the second mesh, to the electronicdisplay for presentation to a viewer.

Example 9

A 3D content rendering system, comprising: electronic memory to store a3D asset including a plurality of meshes; and one or more processingunits configured to: load the plurality of meshes from a characterdefinition; identify a lower depth mesh and a top depth mesh from theplurality of meshes, the lower depth mesh being closer to a center ofthe 3D asset, and the top depth mesh being further from the center ofthe 3D asset; iterate over a plurality of polygons of the lower depthmesh to identify polygons that the top depth mesh and the lower depthmesh share; and hide the shared polygons of the lower depth mesh, suchthat hidden shared polygons are not presented to be perceived be a userduring rendering of the 3D asset.

Example 10

The 3D content rendering system of example 9, wherein the lower mesh isa mesh of a base 3D asset and the top depth mesh is a mesh of afollowing 3D asset.

Example 11

The 3D content rendering system of example 9, wherein the lower mesh isa mesh of a following 3D asset that is associated with a base 3D assetand the top depth mesh is a mesh of another following 3D asset of thebase 3D asset.

Example 12

The 3D content rendering system of example 10 or 11, wherein the base 3Dasset is a bipedal humanoid character, and the following 3D asset is anarticle of clothing.

Example 13

The 3D content rendering system of example 9, wherein shared polygonsfrom the lower mesh and the top depth mesh are identified using a geomapthat identifies a plurality of meshes and an order of the meshes,including the lower mesh and the top depth mesh.

Example 14

The 3D content rendering system of example 9, wherein the lower meshdefines a first set of polygons and the top depth mesh defines a secondset of polygons and shared polygons are at least partially overlapping.

Example 15

The 3D content rendering system of example 9, wherein the one or moreprocessing units are further configured to electronically provide the 3Dasset, including the lower mesh and the top depth mesh, for presentationon a display.

Example 16

The 3D content rendering system of example 9, further comprising anelectronic display for rendering 3D content, wherein the one or moreprocessing units are further configured to electronically provide the 3Dasset, including the lower mesh and the top depth mesh, to theelectronic display for presentation to a viewer.

Example 17

A method of rendering electronic 3D content, the method comprising:loading from a computer-readable memory a first mesh of a 3D asset and asecond mesh of a 3D asset from a character definition; identifying alowest depth mesh of the first mesh and the second mesh, the lowestdepth mesh being closer to a center of the 3D asset; identifying sharedpolygons from the first mesh and the second mesh; and hiding the sharedpolygons of the lowest depth mesh, such that hidden shared polygons arenot presented to be perceived by a user during rendering of the 3Dasset.

Example 18

The method of rendering electronic 3D content of example 17, wherein thefirst mesh is a mesh of a base 3D asset and the second mesh is a mesh ofa following 3D asset.

Example 19

The method of rendering electronic 3D content of example 17, wherein thefirst mesh is a mesh of a following 3D asset that is associated with abase 3D asset and the second mesh is a mesh of another following 3Dasset of the base 3D asset.

Furthermore, the described features, operations, or characteristics maybe arranged and designed in a wide variety of different configurationsand/or combined in any suitable manner in one or more embodiments. Thus,the detailed description of the embodiments of the systems and methodsis not intended to limit the scope of the disclosure, as claimed, but ismerely representative of possible embodiments of the disclosure. Inaddition, it will also be readily understood that the order of the stepsor actions of the methods described in connection with the embodimentsdisclosed may be changed as would be apparent to those skilled in theart. Thus, any order in the drawings or Detailed Description is forillustrative purposes only and is not meant to imply a required order,unless specified to require an order.

Embodiments may include various steps, which may be embodied inmachine-executable instructions to be executed by a general-purpose orspecial-purpose computer (or other electronic device). Alternatively,the steps may be performed by hardware components that include specificlogic for performing the steps, or by a combination of hardware,software, and/or firmware.

Embodiments may also be provided as a computer program product includinga computer-readable storage medium having stored instructions thereonthat may be used to program a computer (or other electronic device) toperform processes described herein. The computer-readable storage mediummay include, but is not limited to: hard drives, floppy diskettes,optical disks, CD-ROMs, DVD-ROMs, ROMs, RAMs, EPROMs, EEPROMs, magneticor optical cards, solid-state memory devices, or other types ofmedium/machine-readable medium suitable for storing electronicinstructions.

As used herein, a software module or component may include any type ofcomputer instruction or computer executable code located within a memorydevice and/or computer-readable storage medium. A software module may,for instance, comprise one or more physical or logical blocks ofcomputer instructions, which may be organized as a routine, program,object, component, data structure, etc., that performs one or more tasksor implements particular abstract data types.

In certain embodiments, a particular software module may comprisedisparate instructions stored in different locations of a memory device,which together implement the described functionality of the module.Indeed, a module may comprise a single instruction or many instructions,and may be distributed over several different code segments, amongdifferent programs, and across several memory devices. Some embodimentsmay be practiced in a distributed computing environment where tasks areperformed by a remote processing device linked through a communicationsnetwork. In a distributed computing environment, software modules may belocated in local and/or remote memory storage devices. In addition, databeing tied or rendered together in a database record may be resident inthe same memory device, or across several memory devices, and may belinked together in fields of a record in a database across a network.

It will be obvious to those having skill in the art that many changesmay be made to the details of the above-described embodiments withoutdeparting from the underlying principles of the invention. The scope ofthe present invention should, therefore, be determined only by thefollowing claims.

The invention claimed is:
 1. A 3D content rendering system, comprising:electronic memory to store a 3D asset including a first mesh and asecond mesh; and one or more processing units configured to: identify anouter mesh and an inner mesh of the first mesh and the second mesh;identify shared polygons from the first mesh and the second mesh; renderthe shared polygons of the outer mesh; and make transparent the sharedpolygons of the inner mesh.
 2. The system of claim 1, wherein the one ormore processing units are further configured to apply a mask to anypolygons of the inner mesh that are not shared with the outer mesh,wherein polygons of the inner mesh that are not shared with the outermesh are portions of the inner mesh that are not occluded by the outermesh.
 3. The system of claim 2, wherein the one or more processing unitsare further configured to render portions of the inner mesh where themask is applied.
 4. The system of claim 1, wherein the one or moreprocessing units are further configured to set values for each sharedpolygon indicating whether each shared polygon is fully occluded orpartially occluded.
 5. The system of claim 1, wherein to identify anouter mesh and an inner mesh, the one or more processing unitsdetermines a depth of the first mesh and a depth of the second meshrelative to a center of the 3D asset.
 6. The system of claim 1, whereinthe first mesh is a mesh of a base 3D asset and the second mesh is amesh of a following 3D asset.
 7. The system of claim 6, wherein the base3D asset is a bipedal humanoid character, and the following 3D asset isan article of clothing.
 8. The system of claim 1, wherein the first meshis a mesh of a following 3D asset that is associated with a base 3Dasset and the second mesh is a mesh of another following 3D asset of thebase 3D asset.
 9. A 3D content rendering system, comprising: electronicmemory to store a 3D asset including a plurality of meshes; and one ormore processing units configured to: identify a lower depth mesh and atop depth mesh from the plurality of meshes, the lower depth mesh beingcloser to a center of the 3D asset, and the top depth mesh being furtherfrom the center of the 3D asset; identify a plurality of polygons thatthe top depth mesh and the lower depth mesh share; render sharedpolygons of the top mesh; and make transparent the shared polygons ofthe lower depth mesh.
 10. The system of claim 9, wherein the one or moreprocessing units are further configured to apply a mask to any polygonsof the lower depth mesh that are not shared with the top mesh, whereinpolygons of the lower depth mesh that are not shared with the top meshare portions of the lower depth mesh that are not occluded by the topmesh.
 11. The system of claim 10, wherein the one or more processingunits are further configured to render the polygons of the lower depthmesh where the mask is applied.
 12. The system of claim 9, wherein theone or more processing units are further configured to set values foreach shared polygon indicating whether each shared polygon is fullyoccluded or partially occluded.
 13. The system of claim 9, wherein afirst mesh of the plurality of meshes is a mesh of a base 3D asset and asecond mesh of the plurality of meshes is a mesh of a following 3Dasset.
 14. The system of claim 13, wherein the base 3D asset is abipedal humanoid character, and the following 3D asset is an article ofclothing.
 15. The system of claim 9, wherein a first mesh of theplurality of meshes is a mesh of a following 3D asset that is associatedwith a base 3D asset and a second mesh of the plurality of meshes is amesh of another following 3D asset of the base 3D asset.
 16. A method ofrendering electronic 3D content, the method comprising: loading from acomputer-readable memory a first mesh of a 3D asset and a second mesh ofa 3D asset from a character definition, the first and second mesh eachcomprising a set of related polygons; identify an outer mesh and aninner mesh of the first mesh and the second mesh; generating a geomapwherein shared polygons from the first mesh and the second mesh areidentified; rendering the shared polygons of the outer mesh; and makingtransparent the shared polygons of the inner mesh.
 17. The method ofrendering electronic 3D content of claim 16, wherein the first mesh is amesh of a base 3D asset and the second mesh is a mesh of a following 3Dasset.
 18. The method of rendering electronic 3D content of claim 16,wherein the first mesh is a mesh of a following 3D asset that isassociated with a base 3D asset and the second mesh is a mesh of anotherfollowing 3D asset of the base 3D asset.
 19. The method of renderingelectronic 3D content of claim 16, further comprising applying a mask toany polygons of the inner mesh that are not shared with the outer mesh,wherein polygons of the inner mesh that are not shared with the outermesh are portions of the inner mesh that are not occluded by the outermesh.
 20. The method of rendering electronic 3D content of claim 19,further comprising rendering portions of the inner mesh where the maskis applied.